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Abstract —Straightforward combination of tree search with 
matching pursuits, which was suggested in 2001 by Cotter and 
Rao, and then later developed by some other authors, has been 
revisited recently as multipath matching pursuit (MMP). In 
this comment, we would like to point out some major issues 
regarding this publication. First, the idea behind MMP is not 
novel, and the related literature has not been properly referenced. 
MMP has not been compared to closely related algorithms such 
as A'orthogonal matching pursuit (A*OMP). The theoretical 
analyses do ignore the pruning strategies applied by the authors 
in practice. All these issues have the potential to mislead the 
reader and lead to misinterpretation of the results. With this 
short paper, we intend to clarify the relation of MMP to existing 
literature in the area and compare its performance with A*OMP. 

Index Terms —compressed sensing, multipath matching pur¬ 
suit, A* orthogonal matching pursuit, tree search 

I. Introduction 

T HE idea of straightforward combination of tree search 
and matching pursuits has been revisited recently as 
multipath matching pursuit (MMP) JT]. Despite MMP has been 
discussed in terms of both theoretical and empirical aspects, 
we believe that 12 lacks some vital aspects including novelty 
and relations to prior work. The absence of these issues can 
easily be misleading and can lead to misrepresentation of the 
algorithm in relation to the existing literature. Consequently, 
we find it very important to clarify these issues, prevent po¬ 
tential misunderstanding and set the literary record straight for 
this family of algorithms. With this motivation, the following 
sections of this comment address three main issues which are 
listed below: 

1) Novelty: Straightforward combination of tree search 
with matching pursuit algorithms as in MMP is not 
novel. Cotter and Rao have already presented this idea 
in 2001 (2), however their work is not referenced in JT|. 
2) Relations to existing sophisticated search techniques: 
MMP is closely related to A* orthogonal matching 
pursuit (A*OMP) 0, (4) which performs a more so¬ 
phisticated tree search via dynamic path selection. MMP 
should have been compared to A*OMP in the first place, 
however this is missing in Q. We present empirical 
results, according to which A*OMP yields clearly higher 
recovery accuracy than MMP. 

Nazim Burak Karahanoglu is with The Informatics and Information 
Security Research Center, The Scientific and Technological Research 
Council of Turkey (TUBITAK BILGEM), Kocaeli, Turkey, (email: bu- 
rak. karahanoglu @ tubitak. gov. tr) 

Hakan Erdogan is with the Faculty of Engineering and Natural Sciences, 
Sabanci University, Istanbul, Turkey, (email: haerdogan@sabanciuniv.edu) 


3) Validity of theoretical analysis: The recovery guaran¬ 
tees presented in ID ignore pruning which the authors 
incorporate for tractability in practice. Though such lim¬ 
itations may be acceptable, their relations to the theory 
should be discussed in order to prevent misinterpretation. 
In addition, the theoretical guarantees of A*OMP in El 
are also valid for MMP and provide a looser condition 
for noise-free recovery of sparse signals. 

II. MMP is not Novel 

While original matching pursuit algorithms 0, © are 
greedy and decide on a single index at each iteration, a 
possible extension considers multiple alternative indices at 
each iteration and performs a tree search among alternative 
index sets to extract a final support set. This idea has been 
suggested by Cotter and Rao 12 in 2001. They have developed 
two strategies for parsing a search tree with branching factor 
K. Among these, MP:M-L is based on a breadth-first strategy. 
It proceeds level by level, exploring K children of each leaf 
and keeping the best M nodes at the next level. When the 
specified depth is reached, the path with the smallest residual 
is returned. MP:K follows a depth-first nature processing the 
paths sequentially. It explores a complete path and termi¬ 
nates if the residual is small enough. Otherwise, the tree is 
backtracked and other candidates are explored one by one 
until the solution is found. Some modifications to increase the 
efficiency and tractability of these methods have later been 
suggested in 0 and ©. 

|Q recalls the idea developed by Cotter and Rao in 
12 under the name multipath matching pursuit. As in 0, 
breadth-first (MMP-BF) and depth-first (MMP-DF) strategies 
are proposed. MMP-BF is equivalent to MP:M-lfi. Similarly, 
MMP-DF is equivalent to MP:K except that MMP-DF places 
an upper limit on the number of explored paths. Hence, neither 
the straightforward combination of tree search with matching 
pursuits nor the developed algorithms are new in JT). Despite 
this fact, the authors do not credit Cotter and Rao or their 
successors. 

III. Relations of MMP to A*OMP 
A. From Straightforward to Sophisticated Tree Search 

As mentioned above, MMP belongs to a group of algorithms 
which are based on straightforward combinations of tree 
search with matching pursuits. On the other hand, A*OMP 

'Though the definition of MMP-BF in [Tj skips pruning of leaf nodes at 
each iteration, the authors still employ this strategy in practice for tractability. 
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algorithm 0 , a has been suggested before MMP in 2012 in 
order to incorporate more sophisticated search heuristics into 
this framework. Based on a combination of A* search with 
OMP, A*OMP employs dynamic path selection techniques. 
The path selection mechanism of A*OMP enables comparison 
of candidates with different number of nonzero indices via 
adaptive cost models based on dedicated auxiliary functions 
and residual energy. This allows for adaptive selection of 
promising candidates on-the-fly in contrast to the predefined 
order of MMP. This more sophisticated strategy promises the 
potential to guide the search in an intelligent manner, and 
improve the recovery accuracy. The enhanced recovery perfor¬ 
mance of A*OMP has been demonstrated via rich simulations 
including recovery probabilities, phase transitions and image 
recovery examples in 0 and 0. These results reveal that 
A*OMP is able to outperform the mainstream algorithms in 
the field in many scenarios in terms of recovery accuracy. In 
addition, A*OMP was shown to enjoy less restrictive exact 
recovery guarantees for noise-free signals 0 than MMP. 

Both being based on exploring multiple candidates via 
search tree structures, A*OMP and MMP belong to the same 
family of algorithms, where A*OMP may be seen as a more 
sophisticated version. In addition, A*OMP is not only an 
earlier proposal but it is also possible to obtain MMP from 
A*OMP via simplification of the path selection strategy. The 
evaluation of MMP cannot be considered complete without 
being compared to a closely related proposal which shows 
strong empirical potential. Consequently, we believe MMP 
should have been compared to A*OMP in terms of both 
algorithmic relations and empirical performance in the first 
place. That neither the algorithmic relations nor empirical 
comparison of MMP and A*OMP is addressed in 0 has the 
potential to mislead the reader and should be considered as a 
vital lack for fair evaluation of MMP. Though this comment 
is not meant for technical details, we present a short empirical 
comparison of A*OMP and MMP below to address this issue. 


B. Empirical Comparison of MMP and A*OMP 

We employ the setup in 0 for empirical comparison. Let 
x £ be a iL-sparse signal (i.e. having only I\ nonzero 
elements) The observation model is y = 4>x where $ £ 
M MxJV j s j-jjg observation matrix and N > M > K. We select 
N = 256, M = 100 and K £ [10,50]. For each K, the test 
is repeated over 500 randomly generated sparse vectors and 
Gaussian observation matrices. We set I = 3 and B = 2 
for A*OMP. MMP-DF is chosen for comparison, since it is 
referred to as the practical one in 0. The branching factor of 
MMP-DF is set to L = 6 as in 0. We allow a maximum of 
200 paths for both algorithms. The average normalized mean- 
squared-error (ANMSE) is defined as 


ANMSE = 


500 

-Y 

on A-, 


500 


2=1 



( 1 ) 


where is the recovery of the zth test vector x 2 . 


2 The definitions of K and M are different than the previous section. 
This choice is made on purpose in order to preserve consistency with the 
corresponding publications El, 0, and 0. 



Fig. 1. Recovery results for the Gaussian sparse signals. 



()• - —^- o 1 -—- 

10 20 30 40 50 10 20 30 40 50 

K K 


Fig. 2. Average number of iterations and average number of explored nodes 
for the Gaussian sparse signals. Note that the numbers should be multiplied 
with 10 3 to get the exact figures. 


We demonstrate two different termination criteria. 
A*OMPi<- and MMPa-DF limit the number of nonzero 
elements by the true K. A*OMP e and MMP e -Dff] terminate 
when || r ||2 < 10 — 6 ||y || 2 , where r is the residue from 
y. Practically, the number of nonzero elements is limited 
to K mdx > K, which is set to 55 here. A*OMPa- uses 
the multiplicative cost model 0 with ctMui = 0.8, while 
A*OMP e employs the adaptive-multiplicative cost model 0 
with ctAMui = 0-97. 

Fig. 0 depicts the exact recovery rates and ANMSE values 
obtained with A*OMP and MMP. It is evident that limiting the 
search to K nonzero indices is suboptimal. A*OMP signifi¬ 
cantly outperforms MMP for both termination criteria, while 
A*OMP e is the top performer. Fig. [2] illustrates the average 
number of iterations and the average number of explored 
nodes for A*OMP e and MMP e -DF. We observe that A*OMP e 
requires significantly fewer iterations and explores fewer nodes 
than MMP e -DF does. 

These findings are expected since A*OMP employs an adap¬ 
tive path selection mechanism, while MMP simply follows a 
predefined order. It is clear that the sophisticated path selection 


3 Application of this termination criterion to MMP is new here, and improves 
the recovery accuracy significantly over (Tj. 
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Fig. 3. Average run times for the Gaussian sparse signals. 


mechanism of A 'OMP is indeed able to guide the search to the 
true solution with higher probability than MMP, and achieves 
this by evaluating fewer candidate solutions. 

Another interesting factor to investigate is the average run 
times. It is important to note that A*OMP„ tests are conducted 
using the optimized AStarOMP software! developed by the 
authors, while MMP tests are run in MATLAEQ While a 
comparison of run times is given in Fig. Q] the numbers are 
not directly comparable due to these implementation details. 
However, the figure still indicates the significant advantages 
of using the optimized AStarOMP software. 

IV. Validity of Theoretical Analysis 

Theoretical performance of MMP has been analysed in 
0 . This analysis provides exact recovery guarantees based 
on the restricted isometry property (RIP) for both noise-free 
and noisy recovery of sparse signals. Though these results 
are applicable to the “theoretical definition” of the algorithm, 
they do ignore the pruning strategies which the authors of 
fll incorporate in practice. As the authors also acknowledge, 
the computational complexity of MMP is still burdensome 
without these pruning strategies. Though such limitations may 
be accepted, their relations to the theory should be clarified 
in order to prevent misinterpretation of the analytical findings. 
Therefore, the Theorems 3.9 and 4.5 should be considered 
together with the pruning strategies for their practical im¬ 
plications. Otherwise, these results may lead to improper 
observations when compared to other algorithms. This may 
be addressed by adding the pruning strategies as assumptions 
to these theorems as done for A*OMP in 0. 

In addition, the exact recovery guarantees 0 developed in 
0 for A*OMP are also valid for MMP. This analysis provides 
a looser (RlP)-based exact recovery condition for noise-free 
recovery of sparse signals than the one in (Tj. To be concrete, 
we present the following lemma: 

Lemma 1: According to the Theorem 2 of 0 , MMP re- 
covers i^-sparse signals exactly from measurements y = 4>x 
under appropriate pruning assumptions if <I> satisfies RIP with 

4 Available at http://myweb.sabanciuniv.edu/karahanoglu/research/ 

5 AStarOMP is based on a trie structure which not only keeps the tree size at 
minimum, but also provides optimal tree modification routines. Unfortunately, 
the authors are unaware of any similar implementations of MMP, and 
developing one is clearly beyond the scope of this comment. 


the restricted isometry constant (RIC) 


Sk+l < 


Vl 

Vk + Vl' 


( 2 ) 


This condition is better than the one in m, since the RIC 
bound in (O is smaller than the following RIC bound from 
Theorem 3.9 of 0: 


Sk+l < 


Vl 

\[K + 2\fL 


(3) 
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